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Abstract 

We consider continuous-time consensus seeking systems whose time-dependent interactions are 
cut-balanced, in tlie following sense: if a group of agents influences the remaining ones, the former 
group is also influenced by the remaining ones by at least a proportional amount. Models involving 
symmetric interconnections and models in which a weighted average of the agent values is conserved 
are special cases. We prove that such systems converge unconditionally. We give a sufficient condition 
on the evolving interaction topology for the limit values of two agents to be the same. Conversely, we 
show that if our condition is not satisfied, then these limits are generically different. Using the fact 
that our convergence result is unconditional, we show that it also applies to systems where the agent 
connectivity and interactions are random, or endogenous, that is, determined by the agent values. 
We also derive corresponding results for discrete-time systems. 



1 Introduction 

We consider continuous-time consensus seeking systems of the following kind: each of n agents, indexed 
by i = 1, . . . , n, maintains a value Xi{t), which is a continuous function of time and evolves according to 
the integral equation version of 

d " 

-x,(0 = ^a.,(i)(x,(t)-x,(t)). (1) 
i=i 

Throughout we assume that each ay (-) is a nonnegative and measurable function. We introduce the 
following assumption which plays a central role in this paper. 

Assumption 1. (Cut-balance) There exists a constant K > I such that for all t, and any nonempty 
proper subset S of {1, . . . , n}, we have 

ies.jfs iesj^s tesjifs 

Intuitively, if a group of agents influences the remaining ones, the former group is also influenced 
by the remaining ones by at least a proportional amount. Systems that satisfy this condition include 
symmetric systems {aijit) = aji(t)), type-symmetric systems {aij(t) < Kaji{t)), and, as will be seen 
later, any system whose dynamics conserve a weighted average (with positive coefficients) of the agent 
values. 
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Under the cut-balance condition ([2]), and without any further assumptions, we prove that each value Xi 
converges to a limit. Moreover, we show that Xi and Xj converge to the same limit if i and j belong to the 
same connected component of the "unbounded interactions graph," i.e., the graph whose edges correspond 
to the pairs for which aij(T)dT is unbounded. (As we will show, while this is a directed graph, 
each of its weakly connected components is also strongly connected.) Conversely, we prove that Xi and Xj 
generically converge to different limits if i and j belong to different connected components of that graph. 
(This latter result involves an additional technical assumption that jj" o-ijiT) dr < oo for every T < oo.) 
Our method of proof is different from traditional convergence proofs for consensus seeking systems, which 
rely on either span-norm or quadratic norm contraction properties. It is inspired from and extends a 
technique used in [S] for the special case of average-preserving systems. It consists of showing that for 
every m < n, a particular linear combination of the values of the m agents with the smallest values is 
nondecreasing and bounded, and that its total increase rate eventually becomes bounded below by a 
positive number if two agents with unbounded interactions were to converge to different limits. 

Motivation for our model comes from the fact that there are many systems in which an agent cannot 
influence another without being subjected to at least a fraction of the reverse influence. This is, for 
example, a common assumption in numerous models of social interactions and opinion dynamics [8ll21) 
or physical systems. For a somewhat more concrete example, consider a network of capacitors with 
capacitances Ci. The ith and jth capacitor are connected by a resistor with time- varying resistance 
Rij (t) = Rji (t) , where the time dependence could represent nonlinearities of the resistors or the effect of 
external actions. The evolution of the potential Vi satisfies Vi{t) = {Vj{t) — Vi{t)) /Rji{t)Ci, which 
can be rewritten in the form ([Ij with aij{t) = l/CiRji{t). Thus, aji{t) G [K~'^aij{t),Kaij{t)\, for all t, 
with K ~ maxij- Ci/Cj. (We call systems with this property type- symmetric.) 

1.1 Background 

Systems of the form ([T]) have attracted considerable attention [T8ll26l28l29ll35] (see also |27I30| for surveys) , 
with motivation coming from decentralized coordination, data fusion [6 ll36j animal flocking [9 |ll5| l34] , and 
models of social behavior [TllllEllHlliaEOlIlT] . 

Available results impose some connectivity conditions on the evolution of the coefficients aij{t), and 
usually guarantee exponentially fast convergence of each agent's value to a common limit ("consensus"). 
For example, Olfati-Saber and Murray [28], consider the system 

j:('j,l)(iE(t) 

with a time-varying directed graph G{t) = {{1, . . . ,n},E{t))\ this is a special case of the model ([T]), 
with aij{t) equal to one if (j, «) G E{t)., and equal to zero otherwise. They show that if the out-degree 
of every node is equal to its in-degree at all times, and if each graph G{t) is strongly connected, then 
the system is average- preserving and each Xi{t) converges exponentially fast to ^ Xj{0). Moreau [3S] 
establishes exponential convergence to consensus under weaker conditions: he only assumes that the aij{t) 
arc uniformly bounded, and that there exist T > and S > such that the directed graph obtained by 
connecting i to j whenever J^*^^ dr > 5 has a rooted spanning tree, for every t. Several extensions 

of such results, involving for example time delays or or imperfect communications, are also available^ 

All of the above described results involve conditions that arc easy to describe but difficult to ensure 
a priori, especially when the agent interactions are cndogcnously determined. This motivates the current 
work, which aims at an understanding of the convergence properties of the dynamical system ([T]) under 
minimal conditions. In the complete absence of any conditions, and especially in the absence of symmetry, 
it is well known that consensus seeking systems can fail to converge; see e.g., Ch. 6 of [2]. On the other 
hand, it also known that more predictable behavior and positive results are possible in the following two 
cases: (i) symmetric (suitably defined) interactions, or (ii) average-preserving systems (e.g., in discrete- 
time models that involve doubly stochastic matrices). 

^It is common in the literature to treat the system JTJ as if the derivative existed for all t, which is not always the case. 
Nevertheless, such results remain correct under an appropriate reinterpretation of 
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1.2 Our contribution 

Our cut-balance condition subsumes the two cases discussed above, and is weaker than the assumptions 
in existing convergence rcsuhs. It allows us to obtain strong convergence results, which would fail to 
hold if the condition were to be removed or even slightly weakened. Indeed, we prove convergence (not 
necessarily to consensus) without any additional conditions, and then provide sufficient and (generically) 
necessary conditions for the limit values of any two agents to agree. In contrast, existing results show 
convergence to consensus under some fairly strong assumptions, but offer no insight on the possible 
behavior when convergence to consensus fails to hold. 

The fact that our convergence result is unconditional (under the cut-balance condition) is significant 
because it allows us to study systems for which the evolution of aij{t) is a priori unknown, possibly 
random or depending on the vector x(t) itself. In the latter models, with endogenously determined agent 
interconnections, it is essentially impossible to check a priori the connectivity conditions imposed in 
existing results, and such results are therefore inapplicable. In contrast our results apply as long as the 
cut-balance condition is satisfied. The advantage of this condition is that it can be often guaranteed a 
priori, e.g., if the system is naturally type-symmetric. 

On the technical side, we note that similar convergence results are available for the special case of 
discrete-time symmetric or type-symmetric systems j51 [T?lfHl[T71froil201l26j , though they are obtained with 
a different methodology. Discrete time is indeed much simpler because one can exploit the following fact: 
either two agents interact on a set of infinite length or they stop interacting after a certain finite time. 
We will indeed show that such existing discrete-time results can be easily extended to the cut-balanced 
case. 



The remainder of the paper is organized as follows. We state and prove our main results in Section [2] and 
briefly discuss their application to systems with random interactions. Wc demonstrate their application 
to systems with endogenously determined interactions in Section [3l We show an analogous result for 
discrete-time systems in Section |31 We end with some concluding remarks and the discussion of an open 
problem on the generalization of our results to systems involving a continuum of agents in Section [SJ 
Appendix |X] contains the proof of a technical result needed in Section [2l 

2 Main Convergence Result and Proof 

We now state formally our main theorem, based on an integral formulation of the agent dynamics. The 
integral formulation avoids issues related to the existence of derivatives, while allowing for discontinuous 
coefficients aij{t) and possible Zeno behaviors (i.e., a countable number of discontinuities in a finite time 
interval) . 

Without loss of generality, we assume that aaii) = for all t. We define a directed graph, G = 
({1, . . . , n}, i!^), called the unbounded interactions graphs by letting (j, i) G £' if aij{t)dt = oo. The 
following assumption will be in effect in some of the results. 

Assumption 2. (Boundedness) For every i and j, and every T < oo, aij{t) dt < oo. 

Theorem 1. Suppose that Assumptions^ (cut-balance) holds. Let x : 3?" be a solution to the 

system of integral equations 



1.3 Outline 




i = 1, . . . , 



n. 



(3) 



(a) The limit x* = limt^.oo Xi{t) exists, and x* G [miuj Xj{0), maxj Xj{0)], for all i. 

(b ) Every weakly connected component of G is strongly connected. 
If, in addition, Assumption\^ (boundedness) holds, then: 
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(c) For every i and j, we have ciijit) l^jit) ~ Xi{t)\ dt < oo. Furthermore, if i and j belong to the 
same connected component of G, then x* — x*. 

(d) If i and j belong to a different connected component of G, then x* ^ x* , unless x{Q) belongs to a 
particular n — 1 dimensional sub-space of ^R" , determined by the functions aij{-). 

The proof of convergence relies on the fact that a particular weighted average of the m smallest 
components Xi{t) is nondecreasing. In order to provide the intuition behind this proof, we first sketch 
the argument for the special case where: (i) the functions Xi{-) are differentiablc, (ii) the ordering of the 
components Xi(t) changes at most a finite number of times during any finite time-interval, and (iii) the 
coefficients satisfy the stronger type-symmetry assumption: < K~^aji{t) < aij(t) < Kaji(t). 

For any time t, let yi{t) be the smallest of the components Xi{t), y2{t) the second smallest, etc., and 
let us define Sm{t) = K~''Vi{t)- Observe that the yi{-) are continuous. Indeed, any two (or more) 

components Xi{-) whose order changes at some time must be equal at that time, by continuity of x{-). 
As a result, Sm{') is also continuous. 

Since we assume that the ordering of the Xi{t) changes at most a finite number of times during a 
finite time-interval, there exists a increasing and divergent sequence io,<i,i2, • ■ • such that the ordering 
remains constant on any {tk,tk+i)- We consider such an interval, on which we assume without loss of 
generality that the Xi{t) are already sorted, in nondecreasing order. Thus, for any t e [tk,tk+i), and 
i > j, we have Xi{t) > Xj{t). Also, yi{t) = Xi{t), and thus Sm{t) ~ J2iLi K^^Xi{t). It follows from ([T]) 
that, for t e {tk,tk+i), 

J m J m n 

-s,n{t) - J2 ^^'"^ d^^'(^) = E ( E «'^(*) (^^ - ^^(^))) • 

z— 1 z— 1 J — 1 

This can be rewritten as 

^ rn m m n 

J^S,n{t) = A-'ay(t) {x,{t) - x,{t)) + E E K-^'^^ii^) i^At) - ^^{t)) ■ 

i—1 j — 1 i—1 J— 771+1 

The second term on the right-hand side is always nonnegative, because the coefficients a^j (t) arc non- 
negative and because we have Xj{t) — Xi{t) > when j > m > i. By rearranging the first term, we 
obtain 

, 771— 1 777 

j^S„M > E E i^^^'^^At) K-^a,,{t)) {x,{t) - xm ■ (4) 

7=1 j=i 

Recall the assumption aij{t) > K^^aji(t) for any i, It implies that 

K''a,,{t) - K-^aj,{t) > aj,{t){K-'^'+'^ - R-^). 

When j > i, as in (j?]), this quantity is nonnegative, and so is Xj{t) — Xi{t). It then follows from ^ that 
^^7n(t) >Ofor alHe (tfc,tfc+i). 

Since our argument is valid for any interval {tk,tk+i), and since the sequence to,ii, . ■ . diverges, this 
implies that S'm(-) is nondecreasing. Observe now that Xi(t) < maxj Xj{0), for all i and t > 0. Thus, 
Smit) is bounded above, and therefore convergent, for any m. As a result, all yi{t) converge, i.e., the 
smallest entry of Xi{t) converges, the second smallest converges, etc. A continuity argument can then be 
used to show the convergence of each Xi{t). 

The proof for the general case relies on following lemma on the rate of change of the weighted sums 
Srn (t) , when the coefficients atj satisfy the cut-balance assumption. We say that a vector y G 5ft" is sorted 
if yi < 2/2 < • ■ • < 2/77- 

Lemma 1. For i,j = I,...,n, i ^ j, let bij be nonnegative coefficients that satisfy the cut-balance 
condition 

^-^EE^.^^EE^^.^^^EE^.»' 

7GS j^S 7GS j^S ieS j^S 
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for some K > 1, and for every nonempty proper subset S o/ {1, . . . , n}. Then, 

111 In \ 

Jor every sorted vector y e 3?", and every m < n. 
Proof. We prove the stronger result that 

n / n \ 

'^bijiyj -yi)\ > 
*=i \i=i / 

for any nonnegative weights Wi such that Wi > KwiJ^i for i ~ 1, ... ,n — 1. Observe that the expression 
above can be rewritten as 

n I n n \ n 

where the last equality serves as the definition of qi. We observe that 

n n n — 1 n 

'i=l 1=1 fc=l i=k+l 

It follows that the desired inequality X]"=i yi^i — holds for every sorted vector y if and only if (i) 
Yh^i qi = 0, and (ii) X)"=fc+i > 0, for fc 1, . . . , - 1. We have 



n In 



1=1 1=1 \j=l j=l / i=l j=l j=l j=l 

which establishes property (i). To establish property (ii), we observe that 

n / n 71 \ 71 k n n ri k 71 n 

i=fc+l \j=l j=l I i=fc+lj = l i=fe+l j=fc+l i=A:+lj = l i=fc+l j=A:+l 

The second and the fourth terms cancel each other. We use the inequality Wj > Wk for j < fc in the first 
term, and the inequality Wi < Wk+i for i > fc + 1 in the third term, to obtain 



i=k+l i=k+l \ j = l j = l / i=fc+lj=l i=fc+l j = l 



fc 



We now use the property Wk > Kwk+i, and then the cut-balance assumption, to conclude that the 
right-hand side in the above inequality is nonnegative, which completes the proof of property (ii). We 
now let Wi = for i = 1, . . . , m, and Wi = for i > m, to obtained the desired result. □ 

We now prove Theorem [TJ 

Proof ( of Theorem 1 ). For every we define a permutation pit) of the indices {1, . . . , n} which sorts the 
components of the vector x{t). (More precisely, it sorts the pairs {xi{t),i) in lexicographic order.) In 
particular, Pi{t) is the index of the ith smallest component of x{t), with ties broken according to the 
original indices of the components of x. Formally, if i<j, then either Xp.(t}{t) < Xp.(^t){i) or Xp.(t)(<) = 
Xp.(^t){i) and pi{t) < pj{t). For every i, we then let yi{t) = Xp.(^t){i)- The vector y(t) is thus sorted, so 
that yi{t)<yj(t) for i<j. Let also bij{t) = ap.(^t)pj{t){t)- (This coefficient captures an interaction between 
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the ith smallest and the jth smallest component of x{t).) Proposition [2l proved in Appendix |X1 states 
that y{t) satisfies an integral equation of the same form as ([3]): 

pt n 

y^{t) = ym+ Y.^^3ii){yJii)^y^ii)) i = l,...,n. (5) 

The definition of the functions 6^ implies that they also satisfy the cut balance condition ^ . We now 
define S„i{t) to be a weighted sum of the values of the first m (sorted) agents: 

rn m n 

i=i •'^ i=i j=i 

It follows from Lemma [U that the integrand is always nonnegative, so that Sm{t) is nondccreasing. 
Moreover, since all bij{t) arc nonnegative, Eq. ([S]) can be used to show that yi{0) < yi{t) < 2/n(0), for all i 
and t. In particular, each Sm{t) is bounded above and therefore converges. This implies, using induction 
on i, that every yi{t) converges to a limit y* = liiRt oo yi{t) G [2/1(0), y„(0)] = [min^ (0), maxj a;j(0)]. 
Using the continuity of x and the definition of y, it is then an easy exercise to show that each Xi{t) must 
also converge to one of the values y* . This concludes the proof of part (a) of the theorem. 

We now prove part (b). Consider a weakly connected component W of the graph G. We assume, 
in order to derive a contradiction, that W is not strongly connected. Consider the decomposition of 
W into strongly connected components. More precisely, we partition the nodes in W into two or more 
subsets Ci, C2, . . ., so that each Ck is strongly connected and so that any edge in W that leaves a strongly 
connected component leads to a component with a larger label. (That is, if i G Ck, (i, j) G and j ^ Ck, 
then i 6 Ci for some / > k.) In particular, there is no edge from C2 U C3 U ■ • • , that leads into Ci. Since 
W is weakly connected, there must therefore exist an edge from Ci into C2 U C3 U • • ■ . However, it is 
an immediate consequence of the cut-balance condition (applied to S* = Ci) that if there is an edge (in 
G) that leaves Ci there must also exist an edge that enters Ci . This is a contradiction, and the proof is 
complete. 

We continue with the proof of part (c). For every m = 1, . . . , n, since Sm converges to some S',*„, we 
have 

/ E E (^) - dt = Sl~ S,n{0) < 00. (6) 

The integrand in this expression can be rewritten as 

rn / 7n n \ m n 

E E ^y^ - (^)) + E (2^™ ^ y^ (^)) + E E ^y^ - (^)) 

i—l — \ J— m+1 / i— 1 j—ni-\-l 

It fohows from Lemma [T] apphed to the coefficients hij and the sorted vector (yi(t), 7/2(i), ■ - ■ , i/m(^); 
ym{t)^ • ■ • , ym{i)) that the ffist term in the sum above is nonnegative, and thus that 

m n ra n 

i=l j — m+1 i—l j — 1 

Equation ^ then implies that 

/EE ^^"*^..W(%W-y™(i))di<^. 

Since K~'''bij{t) > and yj(t) > ym{t) for j > m, every term of the sum in the integrand above 
is nonnegative, for every t. Then, the boundedness of the integral implies the boundedness of every 
/o°° ^iji^) iVji^) ~ ym{t)) dt = Jp°° bij{t) \yj{t) — ym{i)\ dt when m < j. A symmetrical argument shows 
that bij{t) \yj{t) — ym{t) \ dt is also bounded when j < m, so that 

(7) 



/ EE^yWiyjW-y*(*)i'^*<°°- 
•^0 .=i,=i 
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Because of the definitions j/i(T) = Xp.(T-)(T) and bijlr) = ap.(^r)p {T)y andthefaet thatp(t) is a permutation, 
the equahty 

n n n n 

1=1 j=l i=l 3 = 1 

holds for all t, which together with the nonnegativity of all (f) \xj{t) — Xi{t)\ and ([7]) implies that 
/g aii(i) — Xi{t) \ dt < oo for all 

Suppose now that the edge (j, i) is in the graph G, i.e., that aij{t) dt = oo. From part (a), we 

know that \xi{t) — Xj{t)\ converges to a constant value for every Assumption [2] (Jp o,ij{t) dt < oo for 
all t') and Jp°° cnj{t) \xj{t) — Xi{t)\ dt < oo then imply that the value to which \xi{t) — Xj{t)\ converges 
must be 0, and thus that x* = x*. If i and j are not directly connected but belong to the same connected 
component of G, the equality x* = x* follows by using transitivity along a path from i to j. 

It remains to prove part (d). Consider a partition of the agents in two groups, Vi and V2, that are 
disconnected in G, i.e., limt^oc Jq o-ijiT) dr < 00 for all i e Vi and j G V2, and also for all i G V2 and 
j G Vi. Thus, there exists some ti/4 such that 

We will first show that there exists a full-dimensional set of initial vectors a;(0) or which limt_>oo Xi{t) ^ 
lim(_>oo Xj(t), when i € V2 and j & Vi. 

Since aij{T) dr < 00 for any t, the state transition matrix, that maps the initial conditions a;(0) to 
x{t) has full rank for any finite t (see Section 5.5.4 in }16j). 

In particular, we can chose 2;(0) such that Xi{ti/4) = if i G Vi, and x'i(ti/4) = 1 if i G V2. Let m be the 
number of agents in Vi, and y the sorted version of x as above. There holds 2/i(ti/4) = ■ • ■ = ymiti/4) = 
and ym+iiti/4) = • • ■ = y?i(ii/4) = 1. Moreover, the continuity of x implies that if for some t we have 
ymir) < ym+iir) for all r G [ti/4,^], then Xi{t) < ym.(t) for every i G Vl, and Xj(t) > ym+i{t) for every 
i G V2. 

We now show that ym{t) always remains strictly smaller than 2/,„+i(i). Using Eq. ([SJ, we see that for 
t > ^1/4, the evolution of ym{t) satisfies 

/* ™. /■* " 

Y ('^) ~ ym{T)) dT+ Y ^rajij) [yjij) - j/™(t)) dr. (8) 

-1/4 j=l "'*i/4 j=r,i+l 

The first term is non-positive by the definition of y. Consider now the second term. Since ?/i(ii/4) G [0, 1] 
for all I, we obtain yi{t) G [0, 1] for all t > ^1/4, so that yj{t) — y,n{t) < 1 for every j. Equation 1^ and 
the definition of ti/4 imply that 

/■* " 1 

ym{t) < brnj{T)dT < -, 

"'*i/4 j=m+l 

for every t > ii/4. A similar argument shows that ym+iit) > 3/4 for all t > ^1/4. The continuity of x 
then implies that for t > ti/4, we have Xi{t) < 1/4 and Xj{t) > 3/4 for every i G Vi and j G V2. Thus, 
for the particular x{0) that we have chosen, we have limt^.oo Xi{t) ^ lim(_i.oo Xj(t) if i G Vl and j G V2. 

Note that the function that maps the initial condition x(0) to x* = limf_i.oo x(t) is linear; let L be 
the matrix that represents this linear mapping. We use to denote the ith unit vector in We have 
shown above that if i and j belong to different connected components of G, there exists at least one a;(0) 
for which 

X* ~ X* = (e, - ejfLx{0) ^ 0. 

Therefore, (e^ — CjY' L ^ 0. In particular, the set of initial conditions x(0) for which (e^ — Cj)^ Lx{Q) = 
is contained in an n — 1 dimensional subspace of 5R", which establishes part (d) of the theorem. □ 
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We note that Theorem [T] has an analog for the case where each agent's value Xi{t) is actually a 
multi-dimensional vector, obtained by applying Theorem [1] separately to each component. 

The cut-balance condition is a rather weak assumption, but may be hard to check, especially when the 
interactions are not known in advance and depend on the evolution of the states. The proposition that 
follows provides four specific cases of cut-balanced systems that often arise naturally. It should however 
be understood that the class of cut-balanced systems is not restricted to these four particular cases. 

Proposition 1. A collection of nonnegative coefficients aij{-) that satisfies any of the following four 
conditions, for some K > 0, also satisfies the cut-balance condition (Assumption]^. 

(a) Symmetry: we have aij{t) ~ aji{t), for all i^jjt. 

(b) Type- symmetry: we have < K^^aji{t) < aijit) < Kaji{t), for all i,j,t. 

(c) Average preserving dynamics: we have aij{t) = aji{t), for all i,t. 

(d) Weighted average preserving dynamics: There exist Wi > such that Wiaij(t) = Wjaji(t), 
for all t and i. 

Proof. Condition (a) implies condition (b), with K = 1. If condition (b) holds, then by summing over 
all i in some set of nodes 5* and all S, we obtain the cut-balance condition. 

Condition (c) implies condition (d), with Wi = 1. So, it only remains to consider the case where 
condition (d) holds. Suppose that this is the case. We have 

n n 

^ Wjaj,{t) ^^^w^a^^it) - ^ Wjaj,{t) =^^w^a,j{t) ~ ^ w^a^jit). 
iesj^s ies j=i ieSj'es ies j=i ieSjeS 

It follows that J2i£S j^s ''^j'^jii^) ~ Sies j^s ^i'^ii (0' ^^'^ ihus that 

> aj,{t) > > a^j{t). 

^-^ maxi Wi ^-^ 

A reverse inequality follows from a symmetrical argument. Therefore, the cut-balance condition holds 
with K = mini Wi/max^ Wi, which is positive because Wi > for all i. □ 

Note that condition (d) remains sufficient for cut-balance if the weights Wi change with time, provided 
that the ratio (min^ Wi(t))/(maxi ^^(i)) remains uniformly bounded (the same proof applies). 

The key assumption in Theorem (T] which allows us to prove the unconditional convergence of the x^, 
is that the aggregate influence of a group of agents on the others remains within a constant factor of the 
reverse aggregate influence. The type-symmetry condition in Proposition [T] is a local (stronger) version 
of the cut-balance assumption. It requires that aij{t) be positive if and only if aji(t) is positive, and that 
the ratio of these two quantities be bounded. The requirement that the ratio be bounded is essential. To 
demonstrate this, we present an example where aij{t) > whenever aji{t) > 0, but for which convergence 
fails to hold. 

Example 1. Let n — 3 and consider the trajectories 

xi(t)=3 + e-*, X2{t) =sm{t), X3(t) = -3 - e"*. (9) 
These trajectories are a solution to ([T]), for the case where 

1 , ^ 1 

a-Mt) = -tjt; r-T-TT— — , a32{t) 



e*(3-sin(<)) + 1' ^' e*(3 sin(t)) + 1 

1 sin(i) -I- cos(i) 1 sin(t) -|- cos(i) 

= 2 + 6 + 2e-* ' "^^^^^ = 2 " 6 + 2e-* ' 

and ai3(t) = a3i{t) = 0. Note that the trajectory (a;2(t), in particular) does not converge. This system 
satisfies a weak form of type-symmetry: an agent cannot influence another without being itself influenced 
in return, but the ratio between these two influences can grow unbounded. □ 
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One might speculate that the failure to converge in Example [T] is due to the exponential growth 
of some of the ratios aij{t)/aji{t), and that convergence might still be guaranteed if these ratios were 
bounded by a slowly growing function of time. However, this is not the case either: an example with 
fast-growing ratios is equivalent to one with slow-growing ratios, once we rescale the time axis. 

More concretely, let g{t) be a nonnegative increasing function that grows slowly to infinity, and let 
z{t) ~ x{g{t)), where x{-) is as in the preceding example. Then, z{t) satisfies ^ with new coefficients 
aij(t) = g{t)aij{g{t)). The ratio aij{t) /aji{t) is a slowed down version of the ratio aij{t)/aji{t), and is 
therefore slowly growing. On the other hand, since x{t) does not converge, z{t) does not converge either. 

2.1 Systems with random interactions 

We give a brief dicussion of systems with random interactions. Consensus seeking systems where inter- 
actions are determined by a random process have been the object of several recent studies. For example, 
Matei et al. I23| consider the case where the matrix of coefficients (t) follows a (finite-state) irreducible 
Markov process, and is always average-preserving. They prove that the system converges almost surely 
to consensus for all initial conditions if and only if the union of the graphs corresponding to each of the 
states of the Markov chain is strongly connected. This result is extended to continuous-time systems 
in |22| . In |31| , Tahbaz-Salehi and Jadbabaie consider discrete-time consensus-seeking systems where the 
interconnection is generated by an ergodic and stationary random process, without assuming that the 
average is prcrserved. They prove that the system converges almost surely to consensus if and only if an 
associated average graph contains a directed spanning tree. 

It turns out that convergence for the case of random interactions is a simple consequence of deter- 
ministic convergence results: Theorem [T] can be directly applied to systems where the coefficients ay (-) 
are modeled as a random process whose sample path satisfy the cut-balance condition with probability 
1 (possibly with a different constant K or different sample paths). Indeed, if this is the case. Theorem 
[T]implies that each Xi{t) converges, with probability 1. Furthermore, if P(/q aij{t)dt = oo) = 1, then 
X* = X*, with probability 1. 

3 Application to systems with endogenous connectivity 

Theorem [T] dealt with the case where the coefficients aij{t) are given functions of time; in particular, 
x{t) was generated by a linear, albeit time-varying, differential or integral equation. We now show that 
Theorem [1] also applies to nonlinear systems where the coefficients (and the interaction topology) are 
endogenously determined by the vector x{t) of agent values. This is possible because Theorem [T] allows 
for arbitrary variations of the coefficients aij{t), thus encompassing the endogenous case. 

Corollary 1. For every i and j, we are given a nonnegative measurable function Oij : 3?^ x — > 
Let x : — > he a measurable function that satisfies the system of integral equations 

Xi{t) = Xi{Q) + I ^S2aij{T,x{T)){xj{T) - Xi{T))dT, i = l,...,n. (10) 
Jo ^ 

Suppose that there exists K > 1 such that for all x, and t, and any nonempty proper subset S of {1, . . . , n}, 
we have 

^ aji{t,x) < ^ aij{t,x) < K ^ aji{t,x). 

ieSJfS jESj^S iSSj^S 

(a) The limit x* = limt_j.oo 2;^ (t) exists, and x* G [mirij Xj(0),ma,Xj Xj{0)]. 

Define a directed graph G = {{\, . . . ,n},E) by letting (j, i) G E if and only if aij{t, x{t)) dt = oo. 
Finally, assume that aij{t, x{t)) dt < oo for all i and j , and all T < oo. Then: 

(b ) Every weakly connected component of G is strongly connected. 

(c) If i and j belong to the same connected component of G, then x* = x* . 
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Proof. Let us fix a solution x to Eq. (jlOp . For this particular function x, and for every i, j, we define a 
(necessarily measurable) function Oij : ^ 5?+ by letting aij{t) — aij{t,x{t)). By the assumptions of 
the corollary, the functions satisfy the cut-balance condition (Assumption [ij . Furthermore, x is also 
a solution to the system of (linear) integral equations 

Xi{t) ^ Xi{0) + aij{T) {xj{t) - Xi{T)) dr, i = l,...,n. 
Jo 

The result follows by applying Theorem [T] to the latter system. □ 

Note that the nonlinear system of integral equations (jlOp considered in Corollary [T] may have zero, 
one, or multiple solutions; the result applies to every solution, if one exists. Naturally, Corollary [T] 
also holds if the cocfEcients aij{x,t) satisfy stronger conditions such as type-symmetry or the condition 
Wjaji{t, x) = Wiaij{t, x) for some positive coefficients lu^, as in Proposition [TJ 
We note that part (d) of Theorem [T] does not extend to the nonlinear case where the coefficients aij 
also depend on x. Indeed, the proof of Corollary [1] applies Theorem [T] to an auxiliary linear system, and 
the choice of this linear system is based on the actual solution x{-). Part (d) of Theorem [1] does apply 
to this particular linear system, and implies that x* is indeed different from x* whenever i and j belong 
to different connected components of the associated graph G, unless x(0) belongs to a lower-dimensional 
exceptional set. However, this exceptional set is associated with the particular linear system, which is in 
turn determined by a;(0); different a;(0) can be associated with different exceptional sets D{x{0)). So, it 
is in principle possible that every x{0) in a full-dimensional set falls in the exceptional set D{x{0)). This 
is not just a theoretical possibility, as illustrated by the four-dimensional example that follows. 

Example 2. Let n = 4. Consider a sorted initial vector, so that a;i(0) < X2(0) < a;3(0) < 2:4(0). 
Suppose that the coefficients aij have no explicit dependence on time, but are functions of x, with 
diaix) = 031 (x) = 1 and 024(2;) = 042(2;) = 1 as long xi < X2 < x^ < X4. Otherwise, 013 (x) = 
031(2;) = 024(2;) — 042(2;) = 0. All other coefficients are 0. These coefficients are symmetric, and thus 
cut-balanced. The corresponding system has a solution of the following form: xi{t), X2{t) keep increasing 
and X3{t),X4{t) keep decreasing, until some time t* at which agents 2 and 3 hold the same value; after 
that time, all values remain constant. Thus, there is a 4-dimensional set of initial conditions for which 
the resulting limits satisfy o. Note that 

/ aij{t)dt= / aij{t)dt< 00, for alH,j, 
Jo Jo 

and the unbounded interactions graph G has no edges. Yet, despite the fact that nodes 2 and 3 belong to 
different strongly connected components, 2;2 and 2:3 are equal on a 4-dimensional set of initial conditions. 
□ 

We now point out an application of Corollary [TJ Wc consider a nonlinear multi-agent system of a 
form studied in [T|l5|l7lfT0 l[T2lll8p2T|l24] in which the agent values evolve according to the integral equation 
version of 

j^Mt)= J2 i^jit) ~ ^^it)) ■ (11) 

r. \x,{t)-x,{t)\<i 

The evolution of the interaction topology for this system is a priori unknown, because it depends on the a 
priori unknown evolution of x. In addition, the interaction topology can, in principle, change an infinite 
number of times during a finite time interval. Observe that ([TT|) is of the form ([TU]). with o.y (x) = 1 
if \xi — Xj\ < 1, and aij{x) = otherwise. The coefficients Oij are symmetric and therefore satisfy the 
cut-balance condition in Corollary [1] Part (a) of the corollary implies that the limit x* = \mit^ooXi{t) 
exists for every i. Suppose now that for some we have [2;* — 2;*| < 1. Then, there exists a time 
after which \xi{t) — Xj{t)\ < 1 and therefore aij{x{t)) = 1. As a consequence, J^^^ aij{x{t)) dt = 00, and 
Corollary [Tfc) implies that x* = x*. This proves that the system converges, and that the limiting values 
of any two agents are either equal or separated by at least 1, a result which had been obtained by ad hoc 
arguments in [13) . 
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Exactly the same argument can be made for a system that evolves according to the integral equation 
version of 

d Sj: |xi(t)-2:,(t)|<r ~ 

--rXi{t) = — — — — . 

(We let Xi{t) = whenever the denominator on the right-hand side is zero.) This system satisfies a 
type-symmetry condition with K = N . A variant of such a system, with a different interaction radius 
fj for each i, has been studied in |18j under the assumption that the graph of interactions is strongly 
connected at every t. 

A fuerther variation of (fTT|) is of the form 

j^x^it) - /(^j- w - w) (^j- w - ^^(^)) ' (12) 

where / is an even nonnegative function. A multidimensional version of (|12p . where each Xi is a vector, is 
studied in [7] , for the special case of a radially decreasing function / that becomes zero beyond a certain 
threshold. (The results in [7] also allow for a continuum of agents). The system ([T^ is of the form ([TU|) . 
with aij{x) = f{xi — Xj). It satisfies a type-symmetry condition, with K = 1, and Corollary [T] implies 
convergence. Moreover, if / is bounded and is continuous except on a finite set, then for any either 
X* = X*, or X* — X* belongs to the closure of the set {z : f{z) = 0} of roots of /. To see this. Corollary 
[U asserts that if x* 7^ a;*, then f{xi{t) — Xj{t)) dt < oo, which implies that Xi{t) — Xj{t) cannot stay 
forever in a set on which / admits a positive lower bound. 



4 Discrete-time systems 

Much of the literature on consensus-seeking processes actually concerns discrete-time systems. Typical re- 
sults guarantee convergence to consensus under the assumption that the system is "sufficiently connected" 
on any time interval of a certain length [TniliniISS] and sometimes provide bounds on the convergence 
rate. When interactions are type-symmetric, convergence to consensus is guaranteed under the weaker 
assumption that the system remains "sufficiently connected" after any finite time [51 ll7[[^ and results 
2.5.9 and 2.6.2 in [TO]. One can then easily deduce that type-symmetric systems converge unconditionally 
to a limit at which we have consensus within each of possibly many agent clusters [T31[T11[2S] ■ 

In this section, we show that the convergence proof in [51[T5] can be extended easily to prove that cut- 
balance also implies unconditional convergence for the discrete-time case, as in Theorem[TJ A special case 
of this result asserts the unconditional convergence of systems that preserve some weighted average of the 
states, and thus includes a sample path version of recent results of on stochastic consensus-seeking 
systems. 

Discrete-time systems are in some sense simpler because of the absence of Zeno behaviors or unbounded 
sets of finite measure. However, discrete-time systems allow for large instantaneous variations of the 
agents' values. In particular, an agent could entirely "forget" its value at time t when computing its 
value at time i -|- 1, leading to instabilities where agents keep switching their values. For this reason, we 
introduce two additional assumptions: each agent is influenced by its own value when computing its new 
value, and every positive coefficient must be larger than some fixed positive lower bound. 

Theorem 2. Letx -.^^ SR" satisfy 

n 

Xi{t + 1) = 'Yaij{t)xj{t), i = 1, . . . ,n, 

where aij{t) > for all i, j, and t, and X!j=i (^iji't) = 1 for all i and t. Assume that the following three 
conditions hold. 

(a) Lower bound on positive coefficients: there exists some a > such that if aij (t) > 0, then aij{t) > a, 
for all i, j, and t. 

(b) Positive diagonal coefficients: we have aait) > a, for all i and t. 
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(c) Cut-balance: for any nonempty proper subset S 0/ {1, . . . there exist i £ S and j ^ S with 
aij{t) > if and only if there exist i' G S and j' ^ S with aj>ii{t) > 0. 

Then, the limit x* ~ Ihnt^oo Xi{t) exists, and x* £ [muij Xj{0),inaxj Xj{0)]. Furthermore, consider the 
directed graph G = {{1, . . . ,n} , E) in which {j,i) G E if aij{t) > infinitely often. Then, every weakly 
connected component of G is strongly connected, and if i and j belong to the same connected component 
of G, then x* = x* . 

Proof. The fact that every weakly connected component of G is strongly connected is proved exactly as 
in Theorem [T] Consider such a connected component G. It follows from the definition of G that there 
exists a time t* after which aij{t) ~ a-ji{t) — for any i G C and j ^ C. Thus, the values Xi{t) with 
i G C do not influence and are not influenced by the remaining values after time t*. In particular, if 
t* < t' < t, then mhij^c Xj{t') < Xi{t) < maxjgc' Xj(i') holds for all i £ C; furthermore, maxi^c Xi{t) 
and miiiiizc Xi{t) are monotonically nonincreasing and nondecreasing, respectively. 

We now show that there exists a constant 7 > such that for any t' > t* , there exists a t" > t 
for which maxifzc Xi{t") — min^gc < 7( max^gc Xi(i') — miiiitzc Xi{t')^ . We assume that |C| > 2, 

because otherwise the claim is trivially true. 

Suppose that max^gc Xi{t') = 1 and miuigc Xi{t') = 0. This is not a loss of generality; the argument 
can be carried out for any other values by appropriate scaling and translation. For any t, let Gk{t) be 
the set of indices i G C for which Xi{t) > a*"'. Clearly, Go{t') is nonempty. Consider some t and k such 
that ^ Gk{t) 7^ G. We distinguish two cases. 

(i) Suppose that aij{t) = for all i £ Cfe(<) and j £ C \ Gk{t). Then, for any i G Ck{t), we have 

n 

x^{t+l) = ^a,;,(Oa;,(i) = ^ a,j{t)x,{t) > ^ a^X^a^ > 

(We have used here the facts that aij{t) = for every j ^ Gk{t), and a.y(i) = 1.) Therefore, i 
belongs to Ck{t + 1) as well. So, in this case we have Gk{t) C Ck{t + 1). 

(ii) Suppose now that {t) > for some i G Cfc (<) and j G C \ Gk (t) . Then the cut-balance condition, 
together with t > t* , implies that ai'j' > for at least one i' £ G \ Gk (i) and j' G Gk (i) ■ For this 
i' , we have 

n 

Xii {t + 1) = ^ Oiij {t)xj {t) = ^ Oiij {t)xj (t) > a^fji {t)xj' {t) >a - a'' = a''+-^ , 

where we have used the fact that Xj{t) > mmi^c Xi{t') > 0, for all j £ G and t > t' . Therefore, 
i' £ Gk+i{t + 1). Moreover, for any i £ Gk{t), we have Xi{t) = J2jec — 0'ii{t)xi{t) > 

a ■ = because aii{t) > a for all i and t. Thus, if aij{t) > for some i £ Gk{t) and 

j £ G \ Gk{t), then the set Gk+i{t + 1) contains Gk{t) and at least one additional node. 

Recall now that Co(i') is nonempty. Moreover, the definition of C as a strongly connected component 
of G implies that for any t and any nonempty set S* C C, there exists a i and some i £ S, j £ S \ G, 
such that aij{t) > 0. Then, a straigthforward inductive argument based on the above two cases shows 
the existence of a time t" > t' at which G\c\-i{t") = G, i.e., a time t" at which rtAiii^c Xi(t") > a'*-^'"^. 
Since Xi{t) remains less than or equal to 1 for i G C and t > t' , we conclude that 

maxxi{t") - minxi{t") < (l - a'*^'"^) (^iRaxxi{t') - mina;i(i')^ ■ 

This inequality, together with the fact that maxi^c Xi(t) and min^gc Xi(t) are respectively nonincreasing 
and nondecreasing after time t* , implies the convergence of Xi{t), for all i G C, to a common limit. □ 

Observe that the third part of Theorem [1] convergence to generically different values for the different 
components of G, has no counterpart for the discrete-time case. Indeed, if aij{l) = 1/n for all i,j, the 
system reaches global consensus after one time step, irrespective of the connectivity properties of G. 
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Condition (c) in Theorem [2] has a graph-theoretic interpretation. For every t, let Gt be the graph 
on n nodes obtained by connecting j to i if aij{t) is positive. Condition (c) is satisfied if and only if for 
every t, every weakly connected component of Gt is strongly connected. 

Finally, note that convegence results for discrete-time consensus seeking systems with random or en- 
dogenously determined interactions can be derived from Theorem[5]in a straightforward manner, exactly 
as in Section [O] and Corollary [U respectively. 



5 Concluding remarks 

In this paper, we introduced a cut-balance condition, which is a natural and perhaps the broadest possi- 
ble symmetry-like assumption for consensus seeking systems. This assumption is satisfied, in particular, 
if the dynamics preserve a weighted average, or if no agent can infiuence another without incurring a 
proportional reverse influence. Under the cut-balance assumption, we proved the unconditional conver- 
gence of continuous-time consensus seeking systems, and provided a characterization of the resulting local 
consensus, in terms of the evolution of the interaction coefficients. We then applied our results to sys- 
tems with endogenously determined connectivity. Related results were also obtained for the discrete time 
case. We also showed that our result fails to hold if the proportionality constant K in the cut-balance 
assumption can grow with time, without bound. 

We end by discussing the possibility of extending our result to models involving a continuum of agents. 
Such models appear naturally when studying discrete-agent models, in the limit of a large number of 
agents [T1[51[71[TT1[3T]. Let Xt{a) be the value of agent a G [0,1] at time t. Consider then a function 
a; : [0, 1] X ^> 5ft : {a,t) Xa{t) that satisfies 

d f 

— Xa{t)= / aa^pixpit) - Xa{t))dl3, (13) 

for some measurable nonnegative function a : [0,1] x [0,1] x Sft"*" : (a, — aa^i3{t). The extent 

to which our discrete-agent convergence result can be generalized to the model (|13p is an open problem, 
and the same is true in the discrete time-case. 

In addition to some technical difficulties inherent to treating a continuum of agents, the main reason 
that our approach does not apply directly to such systems is the following. Our proofs of Theorem [T] 
and Lemma [1] rely on a collection of functions Sm of the vector of agent states, with the property that 
> -^^^ — if J > where if > 1 is the constant from the cut-balance assumption. Finding 
nontrivial functions having that property seems impossible in the case of a continuum of agents when 
K > 1. Suppose indeed that we have a function S of the configuration of agent values such that 

dxa ~ dXj3 ~ ^ ^ 

when j3 > a. For two agents a < f3, take now a sequence a < 71 < 72 < ■ • • < 7„ < /?. By a repeated 
application of wc obtain > Since this is true for arbitrary n, the derivative of S with 

respect to the agent state would cither be everywhere or unbounded almost everywhere. Whether an 
alternative approach can be used to establish unconditional convergence is an open problem. 

Let us also note that some convergence results are available for some special cases with A' = 1, for 
example because of symmetric interactions, i.e., at(a,/3) = at(/3,a); see [SlIZ])- 
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A Evolution of the sorted vector 

In this appendix we prove that if we sort the components of the vector x, the resulting vector satisfies 
essentially the same evolution equation as the original system, even though the required permutation can 
change with time as the relative order of different components changes. The result appears elementary 
(if not obvious), yet we arc not aware of a simple proof. 
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Proposition 2. Let x : 3?^ — > 3?" 6e a continuous function that satisfies 

Xi[t) = Xi[Q) + I Vi{T)dT, i = l,...,n. (15) 



For any t > 0, let p(t) be the permutation on {l,...,ri} defined by the following lexicographic rule: if 
i < j, then, either (i) Xp.(^t){t) < Xp-(t), or (ii) Xp.(t){'t) = ^pjit) and pi{t) < Pj{t). Then, 

a^P.(t)W = ^p.(o)(0) + / '"p,(T)i'r) dT- (16) 
Jo 

Note that Xp^{t)(t) is a sorted version of x{t), with lexicographic tie breaking. Observe that when all 
Vi (t) arc smooth and the order of x changes only a finite number of times within a bounded interval, the 
result follows immediately from the continuity of Xp.(^t^{t) and the fact that ■^Xp.(^t)it) = Vp^(t){t) on every 
interval on which Pi{t) is constant. The proof that we present here is more general, and only assumes 
measurability. In particular, it allows for infinitely many discontinuities or order changes in finite time, 
something that cannot be ruled out, in general. 

Our proof uses induction on n, starting with the particular cases where n = 2 or ti = 3. 

Lemma 2. Proposition\^ holds when n~2. 

Proof. Let us fix a time i > 0. We only give the proof for the case where a;i(0) < X2(0), so that pi(0) = 1. 
(The proof for the case where a;i(0) > X2{Q) is almost the same.) 

We start by considering the case where pi{t) = 1. Equation ((T5|) . applied to i = 1, yields 

Xl{t)=Xl{0)+ f Vl(T)dT. 

Jo 

We define Ti = {r G [Q,t] : xi{t) < X2{t)} and = {r e [0,t] : xi{t) > X2(t)}. Thus, pi(r) = 1 for all 
r G Ti (including r = 0), and Pi(t) ~ 2 for all t E T2. Moreover, since x is continuous, Ti and T2 are 
measurable sets. Therefore, 



xi(t) = xi(0) + / vi{T)dT+ / ui (r) dr a-pj (0) (0) + / Vp^(^^){T) dr + / vi{t) dr 

JtSTi JreT-i JreTi JT6T2 

The continuity of x, and a fortiori of xi — x'2, implies that T2 is the union of an at most countable 
collection of disjoint open intervals (a^, bk), with < Ok < bk < t, X2{ak) — xi{ak), and X2{bk) — xi{bk)- 
For every such interval, we have 

/•bk rbk 

vi{T)dT ^ xi{bk) - xi{ak) ^ X2{bk) ~ X2{ak) ^ / V2{t) dr ^ I Vp^(r){T)dT, 

Jak J ak 

which implies that 

/ wi(T)dT = V(/ wi(T)dT)=V(/ Vp^i^r){T) dr] = I Vp^^^-^ir) dr. 

J Ten \Jai. / ,. \Jak / JtFT, 



It follows that 

Xpi{t){t) = xi{t) = xi{0) + Wpi(T)(T)rfT + / Vp^(^^){t) dr = Xp^(^o) + Vp^^^^dr, 

JreTi JtgT2 Jo 

as claimed. 

Suppose now that pi{t) ~ 2. Let t* ~ maxjr < t : xi{t) < X2{t)}; the maximum is attained because 
a^i(O) < ^2(0) and x is continuous. Furthermore, xi{t*) = X2{t*), and Pi(t) = 2 for r G {t*,t]. We have 
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Plit*) = Ij so applying the result we have proved above, with the interval [0,t*] replacing [0,t], in the 
fourth equality below, we obtain 



Xpi{t')it*) + / V2{t) dr 



^Pl(O)(0)+ / Vpi(r)(T)(iT+ / Vp^i^r){r)dT 



Jo 

as desired. 

This concludes the proof regarding Xp^(^tj{t). The result for Xp^(^f-^{t) is obtained from a symmetrical 
argument. □ 

Lemma 3. Proposition^^ holds when n ~ 3. 

Proof. The main idea of the proof is to note that min^^i 2,3 Xi{t) = min{a;i(t), min{a;2(t), X3{t)}} and to 
use Lemma [5] twice. 

Let l{t) = 2 if X2{t) < X3{t), and let l{t) = 3 otherwise. Let also Z2{t) = a;;(()(t) and W2{t) = ^((^^(t). 
It follows from Lemma [2l applied to X2{t) and 2:3 (i) that Z2{t) = 2:2(0) + Jq W2{t) dr. 

We let zi{t) = xi{t) and wi{t) ~ vi{t). We then let X{t) = 1 if yi{t) < y2{t), and \{t) ~ 2 otherwise. 
Using Lemma[2]once more, on zi{t) and 22(^)7 we have z\(t){'t) — 2a(o)(0) + /q 'W\(t){t) dr. Observe now 
that mini Xi{t) = min^ ^^(t), so that = 1 when = 1, and pi(t) = l(t) when A(t) = 2. Therefore, 



a^Pi (t) (*) = ^A(t) (i) = ^A(o) (0) + / u;A(r ) (t) dr = (o) (0) + / Vp^ (^) (r) dr. 

Jo Jo 

This proves the desired result for A symmetrical argument shows the result for P3(t) as well. 

It remains to prove the result for P2{t). Observe that since p is a permutation, we have X]i=i ^i(^) 
ELi ^P,it)i't) and X;Li = ELi "p,(t)(0- Therefore, 

2;p2(t)W = -a^piwW -2;p3(t)W 



\i=l 



□ 



We can now prove Proposition [21 using induction. 



Proof. Lemmas [5] and [3] establish the result for n = 2,3. Suppose that the result holds for n — 1, where 
n > 4; we will show that it also holds for n. 

Let q(t) be a permutation on {l,...,n — 1} such that, if i < j then either Xg.^fj(t) < Xq.(^t) oi' 
Xqi{t){t) = Xq.(t) and qi[t) < qj{t). (This corresponds to a sorting of the first n ~ I components of 
x{t), according to the same lexicographic rules used earlier to define p{t).) It follows from our induction 
hypothesis that 
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Let us now fix some k^l, n. We will prove the desired result for Xp^(t). Note that the sorted version 
of x{t) (as captured by the coefficients Pi{t)) is obtained by inserting Xn{t) into the sorted version of 
the first n~ 1 components of x{t) (as captured by the coefficients qi{t)), at the appropriate position. In 
particular, there are only three possible values for pkit), namely qk(t), qk-i{t), and n. In more detail, 
the value of Pk{t) is determined as follows: 

Xn{t) < Xq^_^(t){t) => Pk{t) = qk-l{t), 

Xq^^,{t){t) < Xn{t) < Xg^(t){t) => Pk{t) ^ n, (17) 

Xq^(t)it) < Xn{t) => Pk{t) = qk(t). 

In order to focus on the three possible values oipk{t), we now define zi{t) = Xg^_^(^f^{t), wi{t) — Vg^_i(t)(i), 
Z2{t) = Xgj.(()(i), W2{t) = Ugj,(t)(t), Z3{t) = Xn{t), and 'W3{t) = Vn{t). Let then r{t) be a permutation on 
{1, 2, 3} that sorts the components of z{t) according to the same lexicographic rules used earlier for q and 
p. It follows from (|17p and the definition of z,w,r, that Zr2{t) = Xp^(t){t) a-nd Wj.^(j_){t) — Vp^(^t){t)- Using 
Lemma |3l we obtain 

2^Pfc(t)W = ^r2(t) = ^r2(0)(0) + / W;,.2(r)(T)dT Xp,(o)(0) + / W,,^ (^) (t) dr. 

Jo Ja 

This completes the proof of the result for fc ^ l,n. The proof made use of the induction hypothesis 
together with Lemma [3l The proof for the remaining cases (A; = 1 or A; = n) is entirely similar, except 
that relies on [2] (instead of Lemma [3]). □ 
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